Broadcast receiver selectively using navigation information multiplexed on transport stream and recording medium recording the method of the same

ABSTRACT

A broadcast reception apparatus is provided with a reception unit for receiving broadcast data as a transport stream. The transport stream includes video data and a plurality of navigation information sequences. Each navigation information sequence includes navigation information which includes graphics data to be combined with the video data for display. A TS (Transport Stream) decoder unit extracts the video data and navigation information from the transport stream. A reception control unit controls the TS decoder unit so that the TS decoder unit extracts navigation information from a navigation information sequence which is suitable for the the broadcast reception apparatus. A navigation information storage unit stores the navigation information extracted by the TS decoder unit. A reproduction control unit combines graphics data included in the navigation information stored in the navigation information storage unit with the video data extracted by the TS decoder unit and displays a composite image of this combination. This achieves a broadcast reception apparatus which selectively uses necessary pieces of navigation information to display an image as a user interface.

FIELD OF THE INVENTION

This invention relates to a user interface technique for a broadcastreception apparatus used in a TV broadcast system.

BACKGROUND OF THE INVENTION

Recently, satellite broadcast techniques have remarkably been developed.The Japanese Laid-Open Patent Application No. 5-284506, “MultimediaSelector for Satellite Broadcasts,” discloses a technique for providingmultimedia information being composed of images, voices, and digitaldata by superposing selectable pieces of digital data on an analog imagesignal. For example, it is possible with this technique to superimpose asubtitle on a broadcast image, the subtitle being one out of a pluralityof languages selected by the user and being provided as digital data.This enables users of a broadcast system to select desired informationamong information transmitted to the users in one direction by thebroadcast system. In other words, user interfaces are achieved asmultimedia information transmission systems in which users can selectdesired information.

However, the above conventional technique discloses one video streamwith one fixed user interface (digital data). Such a user interface maynot be suited for all users. Also, it is impossible for programproviders in the broadcast system to provide high-level, effectiveprograms which are respectively arranged for different users since thesystem transmits only fixed user interfaces.

DISCLOSURE OF THE INVENTION

It is therefore an object of the present invention to provide abroadcast reception apparatus which can selectively use navigationinformation to achieve a user interface.

The above object is achieved by a broadcast reception apparatus forreceiving broadcast data as a transport stream, where the transportstream includes video data and a plurality of navigation informationsequences, each of the plurality of navigation information sequencesincludes navigation information which includes graphics data to becombined with the video data for display, the broadcast receptionapparatus comprising: extracting unit for extracting the video data andnavigation information from the transport stream; extract controllingunit for controlling the extracting unit so that the extracting unitextracts navigation information from one out of the plurality ofnavigation information sequences which is related to the broadcastreception apparatus; navigation information storage unit for storing thenavigation information extracted by the extracting unit; andreproduction controlling unit for combining graphics data included inthe navigation information stored in the navigation information storageunit with the video data extracted by the extracting unit and displayinga composite image which is a result of this combination.

The above broadcast reception apparatus may further comprise: operationreceiving unit for receiving a user operation; and apparatus informationstorage unit for storing relationships between operation equipments anda plurality of identifiers of the plurality of navigation informationsequences, the operation equipments being operated by a user to senduser operations to the operation receiving unit, where the operationreceiving unit includes: a signal receiving unit for receiving a signalwhich specifies one out of the operation equipments which is used forthe user operation received by the operation receiving unit, and theextract controlling unit includes: an extract condition setting unit forobtaining from the apparatus information storage unit an identifier of anavigation information sequence which corresponds to the operationequipment specified by the signal received by the signal receiving unitand setting a condition for extracting navigation information in theextracting unit.

With the above construction, it is possible for the broadcast receptionapparatus to obtain the navigation information which includes graphicsdata suitable for the user since the user type can be identified fromthe operation equipment used by the user, achieving a user interface inthe display image.

In the above broadcast reception apparatus, each of the plurality ofnavigation information sequences may include a plurality of sets ofpieces of navigation information, the plurality of sets of pieces ofnavigation information corresponding to respective time periods, andeach set of pieces of navigation information being formed by repeatedlymultiplexing a piece of navigation information during a correspondingtime period, and where the extract condition setting unit sets acondition for extracting navigation information in accordance with atime period.

With such a construction, it is possible to reliably achieve a userinterface related to the display image.

In the above broadcast reception apparatus, the operation equipments maybe a remote controller for adults and a remote controller for children,and the plurality of navigation information sequences may be anavigation information sequence for adults and a navigation informationsequence for children.

With the above construction, it is possible to achieve an optimal userinterface since graphics data for adults or children is read from thecorresponding navigation information sequences and is superimposed onthe video image.

In the above broadcast reception apparatus, each piece of navigationinformation may include display position information and timeinformation, the display position information indicating a position fordisplaying graphics data, the time information indicating a time periodduring which graphics data is displayed, where the reproductioncontrolling unit combines graphics data with the video data inaccordance with the display position information and displays acomposite image in accordance with the time information.

With such a construction, it is possible to achieve a user interfacewith a composite image. In the composite image, the graphics data issuperimposed on the video data at an appropriate position and isdisplayed for an appropriate period, the position and period beingdetermined in accordance with the video data.

The above broadcast reception apparatus may further comprise: apparatusinformation storage unit for storing relationships between displayscreens and a plurality of identifiers of the plurality of navigationinformation sequences, the display screens displaying the compositeimage combined by the reproduction controlling unit, where the extractcontrolling unit includes: an extract condition setting unit forreceiving information indicating one out of the display screens from thereproduction controlling unit, obtaining from the apparatus informationstorage unit an identifier of a navigation information sequence whichcorresponds to the display screen indicated by the information receivedfrom the reproduction controlling unit, and setting a condition forextracting navigation information in the extracting unit.

With such a construction, it is possible to extract navigationinformation suitable for a display screen type to achieve a userinterface.

In the above broadcast reception apparatus, the display screens mayinclude a wide screen with aspect ratio 16:9, a normal screen withaspect ratio 4:3, and a small-scale LCD (Liquid Crystal Display),navigation information corresponding to the wide screen includes displayposition information which indicates a position for displaying graphicsdata, the position being a right-hand side and a left-hand side blankareas generated when a normal-size image is displayed on the widescreen, navigation information corresponding to the normal screenincludes display position information which indicates a position fordisplaying graphics data, the position being a top and bottom blankareas generated when a wide-size image is displayed on the normalscreen, and navigation information corresponding to the small scale LCDincludes display position information which indicates a position fordisplaying graphics data, the position being almost a whole displayarea, the extract controlling unit includes: a size receiving unit forreceiving image size information specifying either of a wide size and anormal size concerning an image of the video data; and a displayinstructing unit for instructing the reproduction controlling unit todisplay the graphics data on a display screen at a position indicated bythe display position information in accordance with the informationindicating one out of the display screens received from the reproductioncontrolling unit and in accordance with the image size informationreceived by the size receiving unit.

With the above construction, it is possible to achieve a user interfacesuitable for the display unit since: graphics data is displayed on aright-hand side and a left-hand side blank areas on the wide screen ifthe image has the normal size; graphics data is displayed on a top andbottom blank areas on the normal screen if the image has the wide size;and graphics data is displayed on almost a whole display area of thesmall-scale LCD.

The above broadcast reception apparatus may further comprise: operationreceiving unit for receiving a user operation; a modem connected to apublic network; and apparatus information storage unit for storing atelephone number of a connection destination to which the modem isconnected, where the extract controlling unit includes: an authoritychecking unit for reading the telephone number, connecting to theconnection destination by the modem, and checking whether a paybroadcast program is to be viewed when the extracting unit extractsvideo data of the pay broadcast program and the operation receiving unitreceives a user operation indicating that the user selects the paybroadcast program; a first extract condition setting unit, when theauthority checking unit receives a confirmation that the pay broadcastprogram is to be viewed, for setting a condition in the extracting unitfor extracting navigation information included in a navigationinformation sequence related to the confirmation that the pay broadcastprogram is to be viewed; and a second extract condition setting unit,when the authority checking unit receives an answer that the paybroadcast program is not to be viewed, for setting a condition in theextracting unit for extracting navigation information included in anavigation information sequence related to the answer that the paybroadcast program is not to be viewed.

With such a construction, it is possible to provide a user interfacewhich appropriately shows the user that the selected program is a paybroadcast program and whether the user is authorized to view theprogram.

In the above broadcast reception apparatus, the authority checking unitmay receive information of a permitted audience time period togetherwith the confirmation that the pay broadcast program is to be viewed,the extract controlling unit includes: a timer unit for activating thesecond extract condition setting unit when the permitted audience timeperiod has expired.

With such a construction, it is possible to inform the user ofunavailability of the program when the permitted audience time periodhas expired.

The above object is also achieved by a broadcast reception apparatus forreceiving broadcast data as a transport stream, where the transportstream includes video data and a plurality of pieces of navigationinformation which includes graphics data to be combined with the videodata for display, the broadcast reception apparatus comprising:operation receiving unit for receiving a user operation; extracting unitfor extracting the video data and navigation information from thetransport stream;

extract controlling unit for controlling the extracting unit so that theextracting unit extracts two or more pieces of navigation informationout of the plurality of pieces of navigation information in accordancewith the user operation received by the operation receiving unit;navigation information storage unit for storing the two or more piecesof navigation information extracted by the extracting unit; andreproduction controlling unit for combining graphics data included inthe two or more navigation information stored in the navigationinformation storage unit with the video data extracted by the extractingunit and displaying a composite image which is a result of thiscombination.

With the above construction, it is possible to extract as many pieces ofnavigation information as necessary from a plurality of pieces ofnavigation information in accordance with the user operation and combinethe graphics data of the extracted pieces of navigation information withthe video data to achieve a user interface. In addition, the capacity ofa storage unit storing the navigation information may be reduced sinceonly necessary pieces of navigation information are stored in thestorage unit.

In the above broadcast reception apparatus, the user operation receivedby the operation receiving unit may be a user attribute, and each of theplurality of pieces of navigation information may include graphics datacorresponding to a user attribute.

With such a construction, it is possible for the user to selectably usenavigation information which is suitable for the user.

The above broadcast reception apparatus may further comprise: a modemconnected to a public network; apparatus information storage unit forstoring a telephone number of a connection destination to which themodem is connected; and transmitting unit for transmitting data to theconnection destination by the modem, the data corresponding to aresponse by a user to the graphics data displayed by the reproductioncontrolling unit.

With the above construction, it is possible to perform a research byunit of questionnaires using display images as a user interface.

The above object is also achieved by a record medium to be used for abroadcast reception apparatus, where the broadcast reception apparatusreceives broadcast data as a transport stream, the transport streamincludes video data and a plurality of navigation information sequences,each of the plurality of navigation information sequences includesnavigation information which includes graphics data to be combined withthe video data for display, the broadcast reception apparatus comprises:an extracting unit for extracting the video data and navigationinformation from the transport stream; and a navigation informationstorage unit for storing the navigation information extracted by theextracting unit, a program is recorded in the record medium, the programincludes: an extract controlling step for controlling the extractingunit so that the extracting unit extracts navigation information fromone out of the plurality of navigation information sequences which isrelated to the broadcast reception apparatus; and a reproductioncontrolling step for combining graphics data included in the navigationinformation stored in the navigation information storage unit with thevideo data extracted by the extracting unit and displaying a compositeimage which is a result of this combination.

With the above construction, the record medium is used in a broadcastreception apparatus not having originally a function of selectingdesired navigation information so that the broadcast reception apparatuscan selectively use navigation information suitable for the apparatus toachieve a user interface.

The above object is also achieved by a record medium to be used for abroadcast reception apparatus, where the broadcast reception apparatusreceives broadcast data as a transport stream, where the transportstream includes video data and a plurality of pieces of navigationinformation which includes graphics data to be combined with the videodata for display, the broadcast reception apparatus comprises: anextracting unit for extracting the video data and navigation informationfrom the transport stream; and a navigation information storage unit forstoring two or more pieces of navigation information extracted by theextracting unit, a program is recorded in the record medium, the programincludes: a determining step for determining a user operation; anextract controlling unit for controlling the extracting unit so that theextracting unit extracts the two or more pieces of navigationinformation out of the plurality of pieces of navigation information inaccordance with the user operation determined in the determining step; acombining step for combining together two or more pieces of graphicsdata included in the two or more navigation information stored in thenavigation information storage unit; and a combination displaying stepfor combining the graphics data combined in the combining step with thevideo data extracted by the extracting unit and displaying a compositeimage which is a result of this combination.

With the above construction, it is possible for a broadcast receptionapparatus to extract as many pieces of navigation information asnecessary to combine their graphics data with the video data and achievea user interface by loading the above record medium even if thebroadcast reception apparatus does not have this function.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the construction of Embodiment 1 ofthe present invention, a broadcast reception apparatus.

FIG. 2 shows the contents of the transport streams received by thereception unit of Embodiment 1.

FIG. 3 shows the script information included in the navigationinformation of Embodiment 1.

FIG. 4 shows a transport stream of Embodiment 1.

FIG. 5 shows remote controllers used in Embodiment 1 as external units.

FIG. 6 shows contents of the apparatus information storage unit ofEmbodiment 1.

FIG. 7 shows an image displayed on the display unit of Embodiment 1.

FIG. 8 shows an image displayed on the display unit of Embodiment 1.

FIG. 9 shows an image displayed on the display unit of Embodiment 1.

FIG. 10 shows an image displayed on the display unit of Embodiment 1.

FIG. 1l shows an image displayed on the display unit of Embodiment 1.

FIG. 12 is a flowchart showing the operation of Embodiment 1.

FIG. 13 is a block diagram showing the construction of Embodiment 2 ofthe present invention, a broadcast reception apparatus.

FIG. 14 shows the contents of the transport streams received by thereception unit of Embodiment 2.

FIG. 15 shows the script information included in the navigationinformation of Embodiment 2.

FIG. 16 shows a transport stream of Embodiment 2.

FIG. 17 shows contents of the apparatus information storage unit ofEmbodiment 2.

FIG. 18 shows an image displayed on the display unit of Embodiment 2.

FIG. 19 shows an image displayed on the display unit of Embodiment 2.

FIG. 20 shows an image displayed on the display unit of Embodiment 2.

FIG. 21 shows an image displayed on the display unit of Embodiment 2.

FIG. 22 shows an image displayed on the display unit of Embodiment 2.

FIG. 23 is a flowchart showing the operation of Embodiment 2.

FIG. 24 is a block diagram showing the construction of Embodiment 3 ofthe present invention, a broadcast reception apparatus.

FIG. 25 shows the contents of the transport streams received by thereception unit of Embodiment 3.

FIG. 26 shows the script information included in the navigationinformation of Embodiment 3.

FIG. 27 shows contents of the apparatus information storage unit ofEmbodiment 3.

FIG. 28 shows an image displayed on the display unit of Embodiment 3.

FIG. 29 shows an image displayed on the display unit of Embodiment 3.

FIG. 30 shows an image displayed on the display unit of Embodiment 3.

FIG. 31 is a flowchart showing the operation of Embodiment 3.

FIG. 32 is a block diagram showing the construction of Embodiment 4 ofthe present invention, a broadcast reception apparatus.

FIG. 33 shows the contents of the transport streams received by thereception unit of Embodiment 4.

FIG. 34 shows the contents of the graphics data included in thenavigation information shown in FIG. 33.

FIG. 35 shows the script information included in the navigationinformation shown in FIG. 33.

FIG. 36 shows an image displayed on the display unit of Embodiment 4.

FIG. 37 shows an image displayed on the display unit of Embodiment 4.

FIG. 38 shows an image displayed on the display unit of Embodiment 4.

FIG. 39 is a flowchart showing the operation of Embodiment 4.

FIG. 40 shows navigation information table NVT (0,2) which has the samecontents as navigation information NVT (0,2) of Embodiment 1.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Preferred embodiments of the present invention, a broadcast receptionapparatus, are described below with reference to drawings.

Embodiment 1

FIG. 1 is a block diagram showing the construction of Embodiment 1 ofthe present invention, a broadcast reception apparatus.

A broadcast reception apparatus 101 is composed of a reception unit 102,a TS (Transport Stream) decoder unit 103, an AV decoder unit 104, anapparatus information storage unit 105, a navigation information storageunit 106, a signal reception unit 107, a reception control unit 108, areproduction control unit 109, a display unit 110, and an audio outputunit 111. With the above construction, the broadcast reception apparatus101 selects a program (event) from a transport stream by usingnavigation information for each user, the transport stream beingbroadcast data transmitted from a broadcast apparatus (not shown in thedrawings).

Note that the transport stream is broadcast data multiplied by an MPEG(Moving Picture Experts Group2) system. The transport stream includesvideo streams and navigation information as described later. Thenavigation information includes graphics data which is superimposed onthe image of broadcast data to interface with the user. The navigationinformation also includes script information for securing an interactivecommunication with the user.

The TS decoder unit 103 includes a filter condition storing unit 112.The signal reception unit 107 receives user operation signals fromremote controllers 113 and 114 being external apparatuses.

The reception unit 102 receives transport streams specified by thereception control unit 108 and outputs the received transport streams tothe TS decoder unit 103.

FIG. 2 shows the contents of the transport streams received by thereception unit 102.

A transport stream 201 includes a video stream 202 and navigationinformation sequences 203 and 204. The video stream 202 is video data ofa world tour guide; the navigation information sequences 203 and 204 areused as user interfaces during reproduction of the video stream 202. Thevideo stream 202 and either of the navigation information sequences 203and 204 make up an event.

The navigation information sequence 203 is a user interface for childrenand includes quizzes which are superimposed on the reproduction image ofthe video stream 202. The navigation information sequence 204 is a userinterface for adults and includes detailed information which issuperimposed on the reproduction image of the video stream 202. Thenavigation information sequences 203 and 204 includes a variety ofcontents corresponding to scenes in the reproduction image.

The navigation information sequence 203 has three versions: NVT (0,0),NVT (0,1), and NVT (0,2); the navigation information sequence 204 hasfive versions: NVT (1,0), NVT (1,1), NVT (1,2), NVT (1,3), and NVT(1,4).

Each piece of navigation information includes graphics data 205, displayinformation 206, time information 207, and script information 208. Thegraphics data 205 is superimposed on the reproduction image; displayinformation 206 specifies a display position and a display frame of thegraphics data 205; time information 207 shows a display effective timefor each version; and script information 208 shows an output operationand a display operation to be performed according to a user operation.For example, NVT (0,0) of the navigation information sequence 203 has adisplay effective time for a period between time t1 and time t2.

FIG. 3 shows a variety of pieces of script information 208 included inrespective pieces of navigation information which are further includedin either of navigation information sequences 203 and 204. For example,NVT (0,1) of the navigation information sequence 203 specifies that acomposite tone of a chime indicating “correct” is output when the userdepresses the ENTER button while “2. EGYPT” is focused on the displayscreen.

NVT (1,N) of the navigation information sequence 204 specifies that“detailed information” is displayed on the screen when variable Y is“1.” The detailed information is graphics data as described above. Notethat the script for a display operation is omitted in NVT (0,N).

FIG. 4 shows the transport stream 201 transmitted from a broadcaststation. As shown in the drawing, each of the video stream 202 and thenavigation information sequences 203 and 204 has its identificationinformation so that the TS decoder unit 103 can separate them from thetransport stream 201.

The video stream 202 has an MPEG-2 compliant identifier PID. Thenavigation information sequences 203 and 204 have an MPEG-2 compliantidentifier PID, a table identification extension (table_id_extension),and a version number (version_no).

The transport stream 201 also includes multiplexed PCRs (Program ClockReference) 401 used for managing the reproduction time. Each version ofthe navigation information sequences 203 and 204 is repeatedlytransmitted during the specified display effective time.

The transport stream 201 includes other multiplexed system informationsuch as PMT (Program Map Table) stipulated in MPEG2 or DVB (DigitalVideo Broadcasting). The system information is not described in thepresent document since it is not relevant to the present invention.Techniques for multiplexing the transport stream are described in “SogoMaruchimedia Sensho MPEG (Selected Book on Multimedia: MPEG), edited bythe Television Society, Ohm Inc., 1994.

The TS decoder unit 103 includes the filter condition storing unit 112for storing a filter condition set by the reception control unit 108.The TS decoder unit 103, according to the set filter condition,separates a video stream, navigation information, and PCRs from thetransport stream output from the reception unit 102. The TS decoder unit103 outputs the separated video stream to the AV decoder unit 104,writes the separated navigation information into the navigationinformation storage unit 106, and outputs the separated PCRs to the AVdecoder unit 104.

The filter condition storing unit 112 stores a plurality of filterconditions. The TS decoder unit 103 performs a plurality of separationprocesses in parallel based on the plurality of filter conditions.

The TS decoder unit 103 separates the video stream from the transportstream and outputs it to the AV decoder unit 104 when the receptioncontrol unit 108 stores PID “0×0096” in the filter condition storingunit 112 as a filter condition.

The TS decoder unit 103 fetches NVT (0,N), which corresponds to one ofthe versions currently transmitted by repetition, and stores it in thenavigation information storage unit 106 when the reception control unit108 stores PID “0×0092” and table_id_extension “0×0000” in the filtercondition storing unit 112. The TS decoder unit 103 then fetches NVT(0,n+1) and stores it in the navigation information storage unit 106when the reception control unit 108 stores version_no “0×0(n+1)” in thefilter condition storing unit 112 as a filter condition, with the PIDand table_id_extension kept unchanged.

The TS decoder unit 103 fetches NVT (1,N), which is currentlytransmitted repeatedly, and stores it in the navigation informationstorage unit 106 when the reception control unit 108 stores PID “0×0093”and table_id_extension “0×0001” in the filter condition storing unit112. The TS decoder unit 103 then fetches NVT (1,n+1) and stores it inthe navigation information storage unit 106 when the reception controlunit 108 stores version_no “0×0(n+1)” in the filter condition storingunit 112 as a filter condition.

The AV decoder unit 104 includes a clock unit which is not shown in thedrawings. The AV decoder unit 104, in synchronization with the clockunit and in compliance with MPEG2, decodes the video stream 202 outputfrom the TS decoder unit 103 and outputs the decoded video stream to thereproduction control unit 109. The clock unit is set to a correctstandard time based on the PCRs output from the TS decoder unit 103 andcounts a standard time to synchronize with the decoding of the videostream 202.

The apparatus information storage unit 105 stores relationships betweenoperations by the user on an external unit and the navigationinformation sequences 203 and 204, the external unit being used totransmit signals to the signal reception unit 107 of the broadcastreception apparatus 101.

FIG. 5 shows appearances of remote controllers 113 and 114, samples ofthe external unit. The remote controller 113 is intended for use byadults, and Chinese characters can be written on the buttons. The remotecontroller 114 is intended for use by children and the buttons can bewritten with Hiragana (a Japanese character) so that children can read.Both remote controllers 113 and 114 have a power key 503, a screendisplay key 504, a “↑” key 505, a “↓” key 506, a “→” key 507, a ←” key508, an enter key 509.

FIG. 6 shows relationships between the remote controllers 113 and 114and the navigation information sequences 203 and 204.

The drawing shows that the navigation information sequence 204 isselectively separated from the transport stream when the remotecontroller 113 is operated by the user; the navigation informationsequence 203 is selectively separated from the transport stream when theremote controller 114 is operated.

The signal reception unit 107 receives a user operation signal fromeither of the remote controllers 113 and 114 and outputs the receivedsignal to the reception control unit 108. For example, the signalreception unit 107 receives a signal specifying an event selected by theuser from events included in the transport stream transmitted from abroadcast station, then outputs the received signal to the receptioncontrol unit 108. In doing this, the signal reception unit 107 alsosends an identification number of remote controller 113 or 114 to thereception control unit 108 together with the signal specifying theevent. The signal reception unit 107 receives a “↑” signal, a “↓”signal, and an enter signal, which are described later, and outputs thereceived signals to the reception control unit 108. When the userpresses the “↑” key 505, “↓” key 506, or enter key 509, the remotecontroller 113 transmits a signal corresponding to the pressed key tothe signal reception unit 107. The “Θ” key 505 and the “1” key 506 areused to change the number in focus on the display unit 110 upward anddownward respectively. The enter key 509 is used to determine to enter anumber or a button in focus.

On receiving an event selection signal input by the user and transferredfrom the signal reception unit 107, the reception control unit 108stores PID “0×0096” in the filter condition storing unit 112 as a filtercondition. On receiving an identification number of a remote controllerfrom the signal reception unit 107, the reception control unit 108refers to the apparatus information storage unit 105 for therelationships between the remote controller and the navigationinformation sequences, and stores a filter condition of the navigationinformation in the filter condition storing unit 112.

When the user uses the remote controller 113, the reception control unit108 receives identification number “1” from the signal reception unit107, reads table_id_extension “0×0001” from the apparatus informationstorage unit 105, stores PID “0×0093” and table_id_extension “0×0001” inthe filter condition storing unit 112 as a filter condition. Note thatthe reception control unit 108 detects the PID value fromtable_id_extension by referring to system information which has not beendescribed.

When the navigation information storage unit 106 stores NVT (1,0), forexample, the reception control unit 108 reads the time information 207corresponding to the NVT (1,0), refers to the clock unit in the AVdecoder unit 104, stores the next version_no “0×01” of the navigationinformation sequence 204 in the filter condition storing unit 112, withthe PID and table_id_extension unchanged, when the display effectivetime comes to an end, reaching time t2.

On receiving the enter signal from the signal reception unit 107 whilethe navigation information storage unit 106 stores NVT (1,0), thereception control unit 108 sets variable Y to “1.”

The reception control unit 108 sends a display instruction to thereproduction control unit 109 according to the display operationspecified in the script information as the NVT changes to (1,1), (1,2),(1,3), or (1,4).

The reception control unit 108 reads the graphics data 205 and thedisplay information 206 from the navigation information storage unit 106and sends them to the reproduction control unit 109.

On receiving the enter signal from the signal reception unit 107 whilethe navigation information storage unit 106 stores NVT (0,1) or (0,2),the reception control unit 108 sets variable X to “−1” according to thescript information if the number in focus set by the reproductioncontrol unit 109 is “1” (representing U.K.) or “3” (representing Japan);the reception control unit 108 sets variable X to “1” if the number infocus is “2” (representing Egypt).

The reception control unit 108 instructs the reproduction control unit109 to output a buzzer for variable X “1” and a chime for variable X“1,” then sets variable X to “0.”

The reproduction control unit 109, according to an instruction from thereception control unit 108, generates an image signal by combining imagedata decoded by the AV decoder unit 104 with graphics data output fromthe reception control unit 108, and outputs the generated image signalto the display unit 110. The reproduction control unit 109 alsogenerates composite tone based on an interpretation of the script sentfrom the reception control unit 108 and outputs the composite tone tothe audio output unit 111. Simultaneously, graphics data is superimposedon the image data at a display position corresponding to a position in adisplay frame of the display screen.

The display unit 110, achieved by a CRT, an LCD (Liquid Crystal Display)or the like, displays images received from the reproduction control unit109.

The audio output unit 111, achieved by a speaker or the like, outputssounds received from the reproduction control unit 109.

The following is a description of specific display operations on thedisplay unit 110. The TS decoder unit 103 separates the video stream 202from the transport stream and outputs it to the AV decoder unit 104 whenthe user selects an event in the transport stream 201 using the remotecontroller 113 during a period between time t1 and time t2. On receivingthe graphics data and the display information, which are user interfacesfor adults, corresponding to NVT (1,0) from the reception control unit108, the reproduction control unit 109 superimposes the graphics data onthe image data decoded by the AV decoder unit 104 at a display positionin a display frame specified by the display information, then outputsthe composite image to the display unit 110. FIG. 7 shows an imagedisplayed on the display unit 110 as a result of the above operation.The reproduction control unit 109 specifies an area on the display unit110 displaying graphics data “detailed information” as a default area infocus. When the user presses the enter key 509 on the remote controller113 under the condition, the TS decoder unit 103 fetches NVT (1,1) attime t2 and stores it in the navigation information storage unit 106.FIG. 8 shows an image displayed on the display unit 110 as a result ofthis operation.

FIG. 9 shows an image displayed on the display unit 110 when the userselects an event using the remote controller 114 during the periodbetween time t1 and time t2. When the user presses the enter key 509under the condition, the display unit 110 shows displays an image asshown in FIG. 10. The reproduction control unit 109 specifies number “1”for U.K. as a default area in focus. When the user presses the “↓” key506 once on the remote controller 114, the reproduction control unit 109receives the “↓” signal from the reception control unit 108 and slidesthe state in focus to number “2” for Egypt. The reproduction controlunit 109 also receives an instruction to output composite tone of achime and instructs the audio output unit 111 to output the compositetone of chime.

The displayed image changes to the one shown in FIG. 11 after time t5.The default in-focus area is number “1” for China. When the user pressesthe enter key on the remote controller 114, the audio output unit 111outputs composite tone of a buzzer.

Now, the operation of the present embodiment is described with referenceto the flowchart shown in FIG. 12.

The TS decoder unit 103 separates video stream 202 from the transportstream, fetches navigation information corresponding to an operation bythe user to select an event on the remote controller, and stores thefetched navigation information in the navigation information storageunit 106 (step S1202). The reception control unit 108 judges whether anoperation signal has been entered by the user (S1204). If no operationsignal has been entered, control goes to S1212. If an operation signalhas been entered, it is judged in step S1206 whether the input operationsignal is one of certain signals such as the enter signal, “↑” signal,and “↓” signal respectively corresponding to the enter key 509, “↑” key505, and “↓” key 506 and whether the remote controller identificationnumber of the operation signal is different from that of the precedingsignal. When the identification number is different, an event(navigation information) different from the current one is fetched(S1208). When the identification number is not different, variable X orY is set to a certain value according to the script information in thenavigation information reflecting the input operation (S1210), thencontrol moves to step S1212.

In step S1212, the reception control unit 108 determines the data to bedisplayed based on the value set as variable X or Y: the receptioncontrol unit 108 determines that the detailed information of thenavigation information sequence 204 should be displayed by referring tothe display operation in the script information when variable Y is “1”;the reception control unit 108 determines that the graphics data of thenavigation information sequence 203 should be displayed when variable Xis “0.”

The reproduction control unit 109 combines the image data of the videostream with the graphics data in the navigation information (S1214). Thedisplay unit 110 displays the composite image. At the same time, theaudio output unit 111 outputs certain composite tone when variable X is“1” or “−1” (S1216). The control then returns to step S1202.

As apparent from the above description, the present embodiment enablesthe broadcast reception apparatus to select a navigation informationsequence corresponding to an external unit. This indicates that as manyuser interfaces as there are external units can be provided usingnavigation information selectively related to the external units used byusers.

Note that in the present embodiment, the navigation information isselected according to the type of the remote controller the useroperates. However, the navigation information may be selected byidentifying the user from an input voice.

A button for changing the navigation information received by thebroadcast reception apparatus may be formed on the remote controller.

In the present embodiment, composite tone is used to indicate whetherthe answer to a quiz is correct or incorrect. However, a message may bedisplayed on the screen for the same purpose.

Embodiment 2

FIG. 13 is a block diagram showing the construction of Embodiment 2 ofthe present invention, a broadcast reception apparatus.

A broadcast reception apparatus 1301 is composed of a reception unit102, a TS decoder unit 103, an AV decoder unit 104, an apparatusinformation storage unit 1302, a navigation information storage unit106, a signal reception unit 107, a reproduction control unit 1303, areception control unit 1304, a display unit 1305, and an audio outputunit 111. With the above construction, the broadcast reception apparatus1301 selects an event from a transport stream by using navigationinformation for each user, the transport stream being broadcast datatransmitted from a broadcast apparatus (not shown in the drawings). TheTS decoder unit 103 includes a filter condition storing unit 112. Thesignal reception unit 107 receives user operation signals from a remotecontroller 113 being an external apparatus.

The broadcast reception apparatus 1301 is composed of almost the samecomponents as the broadcast reception apparatus 101 of Embodiment 1.Accordingly, the following description mainly deals with features uniqueto the present embodiment, with the same reference signs attached to thesame components.

FIG. 14 shows the contents of the transport streams received by thereception unit 102.

A transport stream 1401 includes a video stream 1402 being video data ofa movie “Lost World” and also includes three kinds of navigationinformation, NVT (0), (1), and (2). The video stream 1402 and either ofthe NVT (1) and (2) make up an event.

Each piece of navigation information includes graphics data 1403,display information 1404, and script information 1405. The displayinformation 1404 specifies a display position of the graphics data. NVTs(0), (1), and (2) are respectively for display units 1305 with the widescreen with aspect ratio “16:9,” the normal screen with aspect ratio“4:3,” and small-scale LCD screen.

FIG. 15 shows a variety of pieces of script information corresponding tothe NVTs (0), (1), and (2). The script information specifies acombination operation and a display operation of the graphics data to bedisplayed on the display unit 1305. For example, NVT (0) specifies thata composite image of graphics data 1403 being superimposed on the imagedata should be displayed over a time period between time t1 and time t5if the aspect ratio of the display unit 1305 is 4:3 (normal), and that acomposite image of translucent graphics data 1403 being superimposed onthe image data by “alpha blending” should be displayed for one secondout of 10 seconds during a period between time t1 and time t5 if theaspect ratio of the display unit 1305 is 16:9 (wide).

When a normal-size image is displayed on a wide-size TV, the right-handand left-hand edges of the screen (letter boxes) do not display image.Display information 1404 of NVT (0) specifies display positions of theletter boxes, indicating the areas on the screen occupied by the letterboxes. Display information 1404 of NVT (1) specifies display positionsof top and bottom letter boxes which are generated when a wide-sizeimage is displayed on a normal-size TV. Display information 1404 of NVT(2) specifies almost whole screen of the small-scale LCD screen as adisplay position since the small-scale LCD screen has such a lowresolution as users may feel difficulty in reading small letters.

FIG. 16 shows the transport stream 1401 being transmitted from abroadcast station. The navigation information NVTs (0), (1), and (2) aretransmitted repeatedly during the period between time t1 and time t5.

The video stream of the movie “Lost World” has PID “0×0095” as theidentification information.

NVT (0) has PID “0×0092” and table_id_extension “0×0000,” NVT (1) hasPID “0×0093” and table_id_extension “0×0001,” NVT (2) has PID “0×0094”and table_id_extension “0×0002” as respective identificationinformation.

FIG. 17 shows relationships between screen types of the display unit1305 and the navigation information. The wide screen is related totable_id_extension “0×0000” of NVT (0). The normal screen is related totable_id_extension “0×0001” of NVT (1). The small-scale LCD screen isrelated to table_id_extension “0×0002” of NVT (2).

The reproduction control unit 1303 notifies the reception control unit1304 of the screen type (wide, normal, or small-scale LCD) of thedisplay unit 1305.

The reproduction control unit 1303 also notifies the reception controlunit 1304 of the image size (wide or normal) of the video stream 1402having been decoded by the AV decoder unit 104.

On receiving graphics data, display information, composite operationinformation (indicating either of superimposing or alpha blending), anddisplay time information from the reception control unit 1304, thereproduction control unit 1303 superimposes the graphics data on orcombines the graphics data with the image data of the video streamhaving been decoded by the AV decoder unit 104 according to the displayinformation and displays the composite image on the display unit 1305 asspecified by the display time information referring to the clock unit ofthe AV decoder unit 104.

On receiving the screen type (wide, normal, or small-scale LCD) of thedisplay unit 1305 from the reproduction control unit 1303, the receptioncontrol unit 1304 reads out from the apparatus information storage unit1302 the table identification extension of the navigation informationcorresponding to the received screen type, refers to the systeminformation which is not shown in the drawings, and stores the filtercondition of this navigation information in the filter condition storingunit 112 of the TS decoder unit 103.

On receiving the aspect ratio of the image of the video stream 1402having been decoded by the AV decoder unit 104 from the reproductioncontrol unit 1303, the reception control unit 1304 reads the navigationinformation from the navigation information storage unit 106. Thereception control unit 1304 then sends graphics data, displayinformation, composite operation information (indicating either ofsuperimposing or alpha blending), and display time information to thereproduction control unit 1303.

The display unit 1305 is achieved by a normal-size, a wide-size, or asmall-scale LCD TV.

The following is a description of specific display operations on thedisplay unit 1305.

FIG. 18 shows a screen displayed on the display unit 1305 during aperiod between time t1 and time t2 if the display unit 1305 has the widescreen. Here, the navigation information storage unit 106 stores NVT(0). A letter box 1801 of the wide screen displays graphics data 1403specified by NVT (0). FIG. 19 shows a screen displayed on the displayunit 1305 during a period between time t2 and time t5 if wide-sizeimages are transmitted, as indicated by arrow T in FIG. 14. Note thatthe video as the main image changes with time and that the portionscovered with slashes in the drawing represent translucent graphics data.The graphics data is displayed for one second out of 10 seconds during atime period between time t2 and time t5.

The translucent graphics data prevents the image under the graphics datafrom being entirely covered. Also, the graphics data is displayedintermittently, which enables to display useful information withoutdisturbing the user in his/her watching the video.

The navigation information storage unit 106 stores NVT (1) when thedisplay unit 1305 has a normal-size screen. FIG. 20 shows a screendisplayed on the display unit 1305 of normal size during the periodbetween time t1 and time t2. The drawing shows that translucent graphicsdata is displayed on the image showing the title of the movie “LostWorld.” The graphics data is displayed for one second out of 10 seconds.As shown in FIG. 21, letter boxes 2101 and 2102 appear in the top andbottom portions of the screen during a period between time t2 and timet5 if wide-size images are transmitted, as indicated by arrow T in FIG.14. The graphics data is superimposed on a top letter box 2101.

The navigation information storage unit 106 stores NVT (2) when thedisplay unit 1305 is a small-scale LCD. FIG. 22 shows a screen displayedfor three seconds on the display unit 1305 of the small-scale LCD if thevideo stream 1402 is selected after time t2. The graphics data coversalmost the entire screen so that large characters are displayed sincethe small characters displayed on the small-scale LCD are difficult forthe user to read. Also, the graphics data is displayed only for acertain period so that it does not disturb the user in his/her watchingthe video.

Now, the operation of the present embodiment is described with referenceto the flowchart shown in FIG. 23.

The reception control unit 1304 judges whether a video stream has beenselected by the user (S2302). When a video stream has been selected, afilter condition corresponding to the selected video stream is stored inthe filter condition storing unit 112 of the TS decoder unit 103. Then,on receiving information from the reproduction control unit 1303, thereception control unit 1304 judges whether the screen type of displayunit 1305 is “wide” (S2304). When the screen type is not “wide,” thereception control unit 1304 judges whether the screen type of displayunit 1305 is “normal” (S2306).

When it is judged that the screen type is “wide” in step S2304, thereception control unit 1304 sets a filter condition to fetch NVT (0)(S2308). When it is judged that the screen type is “normal” in stepS2306, the reception control unit 1304 sets a filter condition to fetchNVT (1) (S2310). When it is judged that the screen type is “normal” instep S2306, the reception control unit 1304 sets a filter condition tofetch NVT (2) recognizing the screen type as small-scale LCD (S2312).

After having fetched NVT (0), the reception control unit 1304 judgeswhether the aspect ratio of the decoded image is 4:3 (normal size)(S2314). When having judged that the aspect ratio is 4:3, the receptioncontrol unit 1304 instructs the reproduction control unit 1303 tosuperimpose the graphics data on image data and sends the graphics dataand display information to the reproduction control unit 1303 (S2316).The reception control unit 1304 then instructs the reproduction controlunit 1303 to display the graphics data through the whole time (S2318),and returns to step S2302.

When having judged that the aspect ratio is not 4:3 in step S2324, thereception control unit 1304 instructs the reproduction control unit 1303to combine the graphics data with the image data by alpha blending, andsends the graphics data and display information to the reproductioncontrol unit 1303 (S2320). The reception control unit 1304 theninstructs the reproduction control unit 1303 to display the graphicsdata for one second out of 10 seconds (S2322), and returns to stepS2302.

After having fetched NVT (1), the reception control unit 1304 judgeswhether the aspect ratio of the decoded image is 4:3 (S2324). Whenhaving judged that the aspect ratio is 4:3, the reception control unit1304 executes steps S2320 and 2322 to return to step 2302. When havingjudged that the aspect ratio is not 4:3, the reception control unit 1304executes steps S2316 and 2318 to return to step 2302.

After having fetched NVT (2), the reception control unit 1304 judgeswhether the aspect ratio of the decoded image is 4:3 (S2324). Whenhaving judged that the aspect ratio is 4:3, the reception control unit1304 instructs the reproduction control unit 1303 to combine thegraphics data with the image data by alpha blending, and sends thegraphics data and display information to the reproduction control unit1303 (S2326). The reception control unit 1304 then instructs thereproduction control unit 1303 to display the graphics data for threeseconds (S2328), and returns to step S2302.

As described above, it is possible for the broadcast reception apparatusof the present embodiment to select navigation information in accordancewith the screen types of the display unit 1305 to achieve userinterfaces that display graphics data without disturbing the user inwatching video images.

In the present embodiment, the graphics data is displayed on the displayunit 1305 for a certain period of time. However, the graphics data maybe displayed when the user presses the screen display key 504 on theremote controller 113.

Also, the graphics data may be presented by scrolling display as in textbroadcasting.

Further, the images may be displayed after being compressed so that theuser can watch the graphics data without difficulty (e.g., the videodata is compressed in the vertical direction so that the graphics datais displayed on top and bottom blank portions of the screen which aregenerated by the compression).

Embodiment 3

FIG. 24 is a block diagram showing the construction of Embodiment 3 ofthe present invention, a broadcast reception apparatus.

A broadcast reception apparatus 2401 is composed of a reception unit102, a TS decoder unit 103, an AV decoder unit 104, an apparatusinformation storage unit 2402, a navigation information storage unit106, a signal reception unit 107, a reproduction control unit 109, areception control unit 2404, a display unit 110, an audio output unit111, and a modem 2403. With the above construction, the broadcastreception apparatus 1301 selects an event from a transport stream byusing navigation information related to the status of the broadcastreception apparatus 2401, the transport stream being transmitted from abroadcast apparatus (not shown in the drawings). The TS decoder unit 103includes a filter condition storing unit 112. The signal reception unit107 receives user operation signals from a remote controller 113 beingan external apparatus. Modem 2403 is connected by a public network 2405to an audience authorization center (not shown in the drawings) of a payprogram provider.

The broadcast reception apparatus 2401 is constructed almost the same asthe broadcast reception apparatus of Embodiment 1. Therefore, thefollowing description mainly deals with features unique to the presentembodiment, with the same reference signs attached to the samecomponents.

A transport stream 2501 includes a video stream 2502 being video data ofa movie “Lost World” which is a pay broadcast program and also includesthree navigation information sequences 2503, 2504, and 2505. The videostream 2502 and one out of the navigation information sequences 2503,2504, and 2505 make up an event.

The navigation information sequence 2503, composed of navigationinformation NVTs (0,0) and (0,1), is fetched first when the video streamof the movie “Lost World,” a pay broadcast program, selected.

The navigation information sequence 2504, composed of navigationinformation NVTs (1,0) and (1,1), is fetched for users who have beenauthorized to view the pay broadcast program.

The navigation information sequence 2505, composed of navigationinformation NVT (2,0), is fetched for users who have been authorized toview the pay broadcast program. Each navigation information includesgraphics data 2506, display information (not shown in the drawings), andscript information 2507.

FIG. 26 shows a variety of pieces of script information included in thenavigation information. The reception control unit 2404 refers to thescript information to give an instruction to the reproduction controlunit 109, sets a filter condition for the TS decoder unit 103 to fetch anew piece of navigation information, and connects via modem 2403 to theaudience authorization center by telephone line.

The transport stream 2501 is not described here since it is similar toones shown in FIGS. 4 and 16.

As shown in FIG. 27, the apparatus information storage unit 2402 storesentry navigation information and a telephone number. The entrynavigation information specifies a piece of navigation information whichshould be fetched first when the TS decoder unit 103 separates the videostream 2502 of the pay program. The telephone number is used forchecking whether the user is authorized to view the pay program.

The modem 2403, connected to the public network 2405, connects thebroadcast reception apparatus 2401 to the audience authorization centerwhen the reception control unit 2404 instructs so.

The reception control unit 2404 stores identification information of thevideo stream 2502 in the filter condition storing unit 112 as a filtercondition when the video stream 2502 for the pay broadcast program movie“Lost World” is selected. The reception control unit 2404 then reads theentry navigation information from the apparatus information storage unit2402 and stores identification information of either of NVTs (0,0) and(0,1) in the filter condition storing unit 112 as a filter condition sothat NVT (0,N) is fetched.

The reception control unit 2404 then reads out the script information ofNVT (0,0) or (0,1) from the navigation information storage unit 106,sets variable X to an initial value “2,” sends the graphics data,display information, and time information to the reproduction controlunit 109 with an instruction to superimpose the graphics data on theimage data decoded by the AV decoder unit 104.

The reception control unit 2404 sets variable X to “0” when havingreceived a signal from the signal reception unit 107 which indicatesthat the user has entered the selected pay program.

The reception control unit 2404 then reads out the telephone number ofthe audience authorization center from the apparatus information storageunit 2402. The reception control unit 2404 connects to the center viathe modem 2403 and sends the identification information of the broadcastreception apparatus 2401 itself to check whether the user is authorizedto view the pay program. If the user has paid a fee for viewing theprogram, the audience authorization center sends an audienceauthorization signal to the broadcast reception apparatus 2401 togetherwith a permitted audience time period. If the user has not paid the fee,the audience authorization center sends an audience unauthorizationsignal.

The reception control unit 2404 sets variable X to “1” when receivingthe audience authorization signal, and sets it to “−1” when receivingthe audience unauthorization signal.

Having set variable X to “1,” the reception control unit 2404 stores afilter condition in the filter condition storing unit 112 so that eitherof NVTs (1,0) and (1,1) is fetched. Here, NVT (1,0) is fetched duringthe period between time t1 and time t2; NVT (1,1) is fetched after timet2.

Having set variable X to “−1, ” the reception control unit 2404 stores afilter condition in the filter condition storing unit 112 so that NVT(2,0) is fetched.

When the navigation information storage unit 106 newly stores a piece ofnavigation information, the reception control unit 2404 givesinstructions to the reproduction control unit 109 in accordance with thescript information written in the new piece of navigation information.If the new piece of navigation information is NVT (1,0) and variable Xis “1,” the reception control unit 2404 sends graphics data, displayinformation, and time information to the reproduction control unit 109and instructs it to superimpose the graphics data on the image data anddisplay the composite image. If the new piece of navigation informationis NVT (1,1) and variable X is “1,” the reception control unit 2404sends graphics data and display information to the reproduction controlunit 109 and instructs it to superimpose the graphics data on the imagedata and display the composite image for two seconds. The receptioncontrol unit 2404 then activates a timer and continues to reproduce thepay program until the permitted audience time period has expired. Whenthe permitted audience time period has expired, the reception controlunit 2404 sets variable X to “−1” and stores a filter condition in thefilter condition storing unit 112 so that NVT (2,0) is fetched.

When the navigation information storage unit 106 stores NVT (2,0) andvariable X is “−1,” the reception control unit 2404 sends graphics data,display information, and time information to the reproduction controlunit 109 and instructs it to superimpose the graphics data on the imagedata and display the composite image.

Suppose the video stream 2502 for the movie “Lost World” is selectedduring a period between time t1 and time t2, the display unit 110displays an image as shown in FIG. 28.

Further suppose the user enters the selected pay program to view it.Then, the image shown in FIG. 29 is displayed on the display unit 110after time t2 if the user has been authorized; the image shown in FIG.30 is displayed on the display unit 110 after time t2 if the user hasnot been authorized due to nonpayment of the fee.

Now, the operation of the present embodiment is described with referenceto the flowchart shown in FIG. 31.

The procedure starts as the user selects a video stream which is a payprogram (S3102). Then, it is judged in step S3104 whether the user hasentered the selected pay program indicating that the user has decided toview the program (S3104). When the user has not entered the selected payprogram, the reception control unit 2404 stores a filter condition tofetch either of NVTs (0,0) and (0,1) (S3106). The reception control unit2404 then instructs the reproduction control unit 109 to combine thegraphics data specified by the fetched navigation information with theimage data and display the composite image (S3108). The steps S3106 andS3108 are repeated until the user enters the selected pay program.

When the user has entered the selected pay program, the receptioncontrol unit 2404 judges whether the user has been authorized to viewthe pay program by connecting to the audience authorization center viathe modem 2403 through the public network 2405 and sending theidentification information of the broadcast reception apparatus 2401itself (S3110). Control goes to step S3120 when the user has not beenauthorized to view the pay program.

When it is judged that the user has been authorized to view the payprogram in step S3110, the reception control unit 2404 stores a filtercondition to fetch either of NVTs (1,0) and (1,1) (S3112).

The reception control unit 2404 then instructs the reproduction controlunit 109 to combine the graphics data specified by the fetchednavigation information with the image data (S3114). When NVT (1,0) isfetched, the reception control unit 2404 instructs the reproductioncontrol unit 109 to display the composite image for an effective period;when NVT (1,1) is fetched, the reception control unit 2404 instructs thereproduction control unit 109 to display the composite image for acertain period and activates the timer (S3116).

The reproduction of the pay program is continued until the permittedaudience time period has expired. It is judged whether the permittedaudience time period has expired in step S3118. When it is judged so,the reception control unit 2404 stores a filter condition to fetch NVT(2,0) (S3120). In the following step S3122, the reception control unit2404 instructs the reproduction control unit 109 to combine the graphicsdata specified by NVT (2,0) with the image data and display thecomposite image (S3114), then ends the process.

As described above, the broadcast reception apparatus of the presentembodiment asks the audience authorization center if the user isauthorized to view a pay program, selects a piece of navigationinformation in accordance with the obtained result, and informs the userwhether the user can view the program or not in an appropriate way.

In the present embodiment, the above confirmation is made by checkingvia the public network 2405. However, an identification card or apre-paid card may be inserted into a reading unit of the broadcastreception apparatus for the same purpose, where the identification cardindicates that the user is authorized to view the pay program, and thepre-paid card is given to users having paid the fee for viewing.

Embodiment 4

FIG. 32 is a block diagram showing the construction of Embodiment 4 ofthe present invention, a broadcast reception apparatus.

A broadcast reception apparatus 3201 is composed of a reception unit102, a TS decoder unit 103, an AV decoder unit 104, an apparatusinformation storage unit 3202, a navigation information storage unit3203, a signal reception unit 107, a reproduction control unit 3204, areception control unit 3205, a display unit 110, an audio output unit111, and a modem 3206. With the above construction, the broadcastreception apparatus 1301 selects an event from a transport stream byusing navigation information related to the user of the broadcastreception apparatus 2401, the transport stream being transmitted from abroadcast apparatus (not shown in the drawings). The TS decoder unit 103includes a filter condition storing unit 112. The signal reception unit107 receives user operation signals from a remote controller 113 beingan external apparatus. Modem 3206 is connected by a public network 3207to a broadcast station (not shown in the drawings).

The broadcast reception apparatus 3201 is constructed almost the same asthe broadcast reception apparatus of Embodiment 1. Therefore, thefollowing description mainly deals with features unique to the presentembodiment, with the same reference signs attached to the samecomponents.

FIG. 33 shows the contents of the transport stream received by thereception unit 102.

A transport stream 3301 includes a video stream 3302 and sevennavigation information sequences 3303-3309, the video stream 3302 beingvideo data used as background in a questionnaire program, the sevennavigation information sequences including graphics data as respectivequestions given in the questionnaire program.

The navigation information sequence 3303 is composed of navigationinformation, NVTs (0,0), (0,1), and (0,2). NVT (0,0) is fetched firstwhen the present questionnaire program is selected and entered. Thedisplay effective period for NVT (0,1) lasts from time t2 to time t6.The display effective period for NVT (0,2) is the time after time t6.

The navigation information sequence 3304 is composed of NVT (1).Similarly, each of the navigation information sequences 3305-3309 iscomposed of corresponding one of NVT (2) to NVT (6).

NVT (0,0) is repeatedly transmitted during a period between time t1 andtime t2. NVT (0,1) and NVTs (1)-(6) are repeatedly transmitted during aperiod between time t2 and time t6. NVT (0,2) is repeatedly transmittedafter time t6.

The graphics data specified by NVTs (0,0), (0,1), and (0,2) are shown inFIG. 33. The graphics data specified by NVT (0,0) is superimposed on thebackground image to urge the user to input user attributes by the remotecontroller 113. The input user attributes are used by the broadcastreception apparatus 3201 to select questions for the user. The graphicsdata specified by NVT (0,1) is combined with the graphics data specifiedby any one selected from NVTs (1)-(6) and the composite image is furthersuperimposed on the background image to be displayed. The graphics dataspecified by NVT (0,2) is superimposed on the background image to informthe user that the broadcast reception apparatus 3201 is transmittinganswers to the questions.

The graphics data specified by NVTs (1)-(6) are shown in FIG. 34. NVT(1) specifies Question 1 for male. NVT (2) specifies Question 1 forfemale. NVT (3) specifies Question 2 for adults. NVT (4) specifiesQuestion 2 for children. NVT (5) specifies Question 3 for the Kantodistrict in Japan. NVT (6) specifies Question 3 for the Kansai districtin Japan. Each question provides answer options “yes” and “no.”

Note that each piece of navigation information includes displayinformation and time information as well as the graphics data though theformer pieces of information are not shown in the drawing.

NVTs (0,0), (0,1), and (0,2) include script information as shown in FIG.35. A piece of script information specifies an NVT to be selected basedon the user attributes input from the user by the remote controller 113.Another piece of script information specifies that the answers to thequestions are transmitted to the broadcast station.

The user attributes dealt with by the script information of NVT (0,0)are “sex,” “age,” and “address.” A reception control unit 3205, which islater described, sets variable X to “1” when the user operates a certainkey on the remote controller 113 to inform that the user is male, setsvariable X to “2” when the user is female, sets variable Y to “3” whenthe user informs of his age being 20 or more, sets variable Y to “4”when the user informs of his age being less than 20, sets variable Z to“5” when the user lives in the Kanto district, and sets variable Z to“6” when the user lives in the Kansai district.

Variable X is used to select either of NVTs (1) and (2). Similarly,variable Y is used to select either of NVTs (3) and (4) and variable Zis used to select either of NVTs (5) and (6).

The reception control unit 3205 sets variables A1, A2, and A3 to “0” asthe respective initial values. Variables A1, A2, and A3 are set to “1”or “2” in accordance with the answers to the questions.

The script information of NVT (0,1) specifies a display operation ofcombining four pieces of graphics data specified by NVTs (0,1), (X),(Y), and (Z) together and displaying the composite image. The scriptinformation of NVT (0,1) also specifies an input operation of settingvariables A1, A2, and A3 to “1” or “2.”

Suppose the user enters “1 yes” as an answer to question 1, then thereception control unit 3205 sets variable A1 to “1.” Similar operationsare performed for variables A2 and A3.

The script information of NVT (0,2) specifies that the values asvariables X, Y, Z, A1, A2, and A3, which are set in accordance withinformation input from the user during a period between time t1 and timet6, are transmitted to the broadcast station.

The apparatus information storage unit 3202 stores entry navigationinformation, the entry navigation information being identificationinformation of NVT (0,0) which is fetched first when the video stream3302 is separated from the transport stream 3301 in accordance with auser operation. The apparatus information storage unit 3202 also storesidentification information of NVTs (0,1) and (0,2) and the telephonenumber of the broadcast station.

The navigation information storage unit 3203 stores the navigationinformation separated from the transport stream by the TS decoder unit103. The present embodiment differs from Embodiments 1-3 in that thenavigation information storage unit 3203 stores a plurality of pieces ofnavigation information.

The reproduction control unit 3204, on receiving the graphics data,display information, and time information from the reception controlunit 3205, combines the graphics data with the image data decoded by theAV decoder unit 104 and displays the composite image on the display unit110 for the display effective period.

The reception control unit 3205 stores a filter condition in the filtercondition storing unit 112 of the TS decoder unit 103 so that the videostream 3302 is separated from the transport stream 3301 received by thereception unit 102 when the user selects and enters the questionnaireprogram. The reception control unit 3205 then reads the entry navigationinformation from the apparatus information storage unit 3202 and storesa filter condition for NVT (0,0) in the filter condition storing unit112.

When NVT (0,0) is stored in the navigation information storage unit3203, the reception control unit 3205 reads out the graphics data,display information, and time information as specified in NVT (0,0) andalso reads out the script information (see FIG. 35). The receptioncontrol unit 3205 sends the graphics data, a combination instruction,and a display instruction to the reproduction control unit 3204.

On receiving information from the user via the signal reception unit107, the reception control unit 3205 sets variables X, Y, and Z torespective values and sets variables A1, A2, and A3 to “0” as theirinitial values.

The reception control unit 3205 stores filter conditions in the filtercondition storing unit 112 to fetch NVTs (X), (Y), (Z), and (0,1) inaccordance with the values specified as variables X, Y, and Z.

When the navigation information storage unit 3203 stores NVTs (X), (Y),(Z), and (0,1), the reception control unit 3205 reads out the scriptinformation of NVT (0,1), sends the graphics data of NVTs (X), (Y), (Z),and (0,1) to the reproduction control unit 3204 in accordance with theread script information, instructing to combine the sent graphics datawith the image data and display the composite image.

On receiving signals from the user via the remote controller and thesignal reception unit 107, the reception control unit 3205 setsvariables A1, A2, and A3 to certain values in accordance with the inputoperation specified in the script information (see FIG. 35). When itpasts time t6 after the above values have been set, the receptioncontrol unit 3205 stores a filter condition in the filter conditionstoring unit 112 to fetch NVT (0,2).

When the navigation information storage unit 3203 stores NVT (0,2), thereception control unit 3205 sends the graphics data of NVT (0,2) to thereproduction control unit 3204 with an instruction to combine the sentgraphics data with the image data and display the composite image.

The reception control unit 3205 reads out the telephone number of thebroadcast station from the apparatus information storage unit 3202 andconnects the broadcast reception apparatus 3201 to the broadcast stationvia the modem 3206 and the public network 3207. The reception controlunit 3205 then transmits the values of variables X, Y, Z, A1, A2, and A3to the broadcast station.

Modem 3206 is used to connect the broadcast reception apparatus 3201 tothe broadcast station (not shown in the drawings) via the public network3207.

The following is a description of specific display operations on thedisplay unit 110. FIG. 36 shows an image displayed on the display unit110 during a period between time t1 and time t2 after the user selectsand enters the questionnaire program. FIG. 37 shows an image displayedon the display unit 110 during a period between time t2 and time t6after the user inputs information using the remote controller 113 thatthe user is female, 20 or more in age, and lives in the Kansai district.Note that the background has changed.

During the period between time t2 and time t6, the user answers to thequestions using keys on the remote controller 113, such as “↓,” “→,” and“enter.” The reception control unit 3205 converts the receivedinformation into certain values and, after time t6, transmits the valuesto the broadcast station via the modem 3206.

FIG. 38 shows an image displayed on the display unit 110 during a periodbetween time t2 and time t6 after the user inputs information that theuser is male, 20 or more in age, and lives in the Kanto district.

Now, the operation of the present embodiment is described with referenceto the flowchart shown in FIG. 39.

The reception control unit 3205 stores a filter condition in the filtercondition storing unit 112 to fetch the video stream 3302 when thequestionnaire program is selected and entered (S3902).

The reception control unit 3205 then stores a filter condition in thefilter condition storing unit 112 to fetch NVT (0,0) as entry navigationinformation (S3904).

After the user enters his/her sex, age, and address on the screen shownin FIG. 36, the reception control unit 3205 sets variables X, Y, and Zto certain values and sets variables A1, A2, and A3 to initial values(S3906).

After time t2, the reception control unit 3205 stores a filter conditionin the filter condition storing unit 112 to fetch NVT (0,1) (S3908). Thereception control unit 3205 then stores filter conditions in the filtercondition storing unit 112 to fetch NVTs (X), (Y), and (Z) and instructsthe reproduction control unit 3204 to combine the sent graphics data ofNVTs (X), (Y), (Z), and (0,1) with the image data and display thecomposite image (S3910). The reception control unit 3205 continues toreceive answers from the user to the questions until time t6 (S3912).The reception control unit 3205 sets variables A1, A2, and A3 to certainvalues (S3914).

After time t6, the reception control unit 3205 stores a filter conditionin the filter condition storing unit 112 to fetch NVT (0,2) (S3916). Thereception control unit 3205 then instructs the reproduction control unit3204 to combine the graphics data with the image data and display thecomposite image, and transmits the values of variables X, Y, Z, A1, A2,and A3 to the broadcast station (S3918). This operation procedure endswith this process.

The present embodiment deals with a questionnaire program. However, thepresent embodiment may also be applied to a quiz program. Suppose adifferent set of questions are given to each of two types of respondents(users), with three questions per screen. The combination is representedas 2×2×2=8. If the combination should be arranged in the broadcaststation side, the broadcast station needs to provide eight pieces ofnavigation information. On the other hand, if the broadcast receptionapparatus 3201 arranges the three questions for each user type, thecombination of the questions is represented as 3×2=6. When this happens,less pieces of navigation information are used to provide the samequality of services when the broadcast reception apparatus 3201 createsone piece of navigation information with three questions. This leads toa cost down of the apparatus due to reduction of the capacity ofnavigation information storage unit 3203.

As described above, a lot of display patterns are gained by combining asmall number of pieces of navigation information in the presentembodiment.

In the present embodiment, the questionnaire text is displayed on thedisplay unit 110. However, the text may be output as composite tone fromthe audio output unit 111 so that the user can understand the questions.

The audio data is not described in detail in the above embodiments.Actually, however, the audio data is multiplexed in the transport streamand is output from the audio output unit 111 in synchronization withcorresponding images.

The navigation information described in Embodiments 1-4 may betransmitted from a broadcast apparatus as a navigation informationtable, such as NVT (0,2) shown in FIG. 40.

The navigation information table 4001 shown in FIG. 40 includes the samecontents as NVT (0,2) for the navigation information sequence 203described in Embodiment 1 (see FIGS. 2 and 3).

The navigation information table 4001 includes object definition table4002, handler definition table 4003, and bitmap table 4004.

The object definition table 4002 shows types and attributes of graphicsobjects. For example, “button” is one type of the graphics objects. The“index” column shows index numbers for objects. The “type” column showstypes of the graphics objects. The “X” and “Y” columns respectively showthe coordinate values of display standard positions on the displayscreen. The “handler” column shows index numbers for handlers which areexecuted when corresponding objects are selected. The “normal bitmap”column shows index numbers for bitmaps which are displayed whencorresponding objects are in normal state. The “focused bitmap” columnshows index numbers for bitmaps which are displayed when correspondingobjects are in selected state. The normal state indicates that thecorresponding object is merely displayed. The selected state indicatesthat the corresponding object is selected.

For example, the object definition table 4002 indicates that for theobject with index number “0,” the handler with index number “3” isexecuted, that in the normal state, the bitmap with index number “6” isdisplayed, and that in the selected state, the bitmap with index number“7” is displayed. This is similarly applied to the objects with indexnumbers “1” and “2.”

The handler definition table 4003 shows scripts which each defineoperations of the broadcast reception apparatus 101 related to useroperations.

For example, the script for the handler with index number “3” states“PlayAudio(“BEEEEE”).” This script defines an instruction to outputcomposite tone of a buzzer.

The bitmap table 4004 shows bitmap data which is graphics datasuperimposed on video image data by the broadcast reception apparatus101, where the bitmaps in the bitmap table 4004 correspond to those inthe object definition table 4002.

For example, the bitmap with index number “6” in the bitmap tablecorresponds to the normal bitmap for the object with index number “0” inthe object definition table 4002.

Note that the “input operation” defined in NVT (0,2) of Embodiment 1(see the script information shown in FIG. 3) is achieved by handlers inthe navigation information table 4001 of FIG. 40. Accordingly, the valuespecified as variable X in Embodiment 1 has no substantial meaning.

The navigation information in the above embodiments does not definehyperlink information. However, a hyperlink table showing link targetsmay be used when the navigation information defines hyperlinkinformation.

The broadcast reception apparatus 101 or the like described inEmbodiments 1-4 may be recorded as a program in a record medium, such asa ROM card, the program realizing the functions of the reception controlunit, the reproduction control unit, and other elements shown in FIG. 1.This enables a broadcast reception apparatus to have the functions ofthe broadcast reception apparatus 101 of the present invention byinserting the ROM card into a card slot of the broadcast receptionapparatus.

Industrial Use Possibility

The broadcast reception apparatus of the present invention is veryuseful in that it can separate only necessary pieces of navigationinformation from a transport stream into which video data and aplurality of pieces of navigation information are multiplexed and thatit can generate and display a composite image using data specified bythe separated navigation information. The function of providingdifferent user interfaces for corresponding users has a high practicalmerit.

What is claimed is:
 1. A broadcast reception apparatus for receivingbroadcast data as a transport stream, wherein the transport streamincludes video data and a plurality of navigation information sequences,each of the plurality of navigation information sequences includesnavigation information which includes graphics data to be combined withthe video data for display, the broadcast reception apparatuscomprising: extracting means for extracting the video data andnavigation information from the transport stream; apparatus informationtype storage means for prestoring information indicating a type of anavigation information sequence from which the navigation information isto be extracted; extract controlling means for controlling theextracting means so that the extracting means extracts navigationinformation from one out of the plurality of navigation informationsequences according to the information stored in the navigationinformation type storage means; navigation information storage means forstoring the navigation information extracted by the extracting means;and reproduction controlling means for combining graphics data includedin the navigation information stored in the navigation informationstorage means with the video data extracted by the extracting means anddisplaying a composite image which is a result of this combination. 2.The broadcast reception apparatus of claim 1, wherein each piece ofnavigation information includes display position information and timeinformation, the display position information indicating a position fordisplaying graphics data, the time information indicating a time periodduring which graphics data is displayed, wherein the reproductioncontrolling means combines graphics data with the video data inaccordance with the display position information and displays acomposite image in accordance with the time information.
 3. A broadcastreception apparatus for receiving broadcast data as a transport stream,wherein the transport stream includes video data and a plurality ofnavigation information sequences, each of the plurality of navigationinformation sequences includes navigation information which includesgraphics data to be combined with the video data for display, thebroadcast reception apparatus comprising: extracting unit for extractingthe video data and navigation information from the transport stream;extract controlling unit for controlling the extracting unit so that theextracting unit extracts navigation information from one out of theplurality of navigation information sequences which is related to thebroadcast reception apparatus; navigation information storage unit forstoring the navigation information extracted by the extracting unit;reproduction controlling unit for combining graphics data included inthe navigation information stored in the navigation information storageunit with the video data extracted by the extracting unit and displayinga composite image which is a result of this combination; operationreceiving unit for receiving a user operation; and apparatus informationstorage unit for storing relationships between a plurality of equipmentoperation and a plurality of identifiers of the plurality of navigationinformation sequences, the operation equipment being operated by a userto send user operations to the operations receiving unit, wherein theoperation receiving unit includes: a signal receiving unit for receivinga signal which specifies one out of the plurality of operation equipmentwhich is used for the user operation received by the operation receivingunit, and the extract controlling unit includes: an extract conditionsetting unit for obtaining from the apparatus information storage unitan identifier of a navigation information sequence which corresponds tothe operation equipment specified by the signal received by the signalreceiving unit and setting a condition for extracting navigationinformation in the extracting unit.
 4. The broadcast reception apparatusof claim 3, wherein each of the plurality of navigation informationsequences includes a plurality of sets of pieces of navigationinformation, the plurality of sets of pieces of navigation informationcorresponding to respective time periods, and each set of pieces ofnavigation information being formed by repeatedly multiplexing a pieceof navigation information during a corresponding time period, andwherein the extract condition setting unit sets a condition forextracting navigation information in accordance with a time period. 5.The broadcast reception apparatus of claim 2, wherein the plurality ofoperation equipment include a remote controller for adults and a remotecontroller for children, and the plurality of navigation informationsequences are a navigation information sequence for adults and anavigation information sequence for children.
 6. A broadcast receptionapparatus for receiving broadcast as a transport stream, wherein thetransport stream includes video data and a plurality of navigationinformation sequences, each of the plurality of navigation informationsequences includes navigation information which includes graphics datato be combined with the video data for display, the broadcast receptionapparatus comprising: extracting unit for extracting the video data andnavigation information from the transport stream; extract controllingunit for controlling the extracting means so that the extracting unitextracts navigation information from one out of the plurality ofnavigation information sequences which is related to the broadcastreception apparatus; navigation information storage unit for storing thenavigation information extracted by the extracting means; reproductioncontrolling unit for combining graphics data included in the navigationinformation stored in the navigation information storage unit with thevideo data extracted by the extracting unit and displaying a compositeimage which is a result of this combination; apparatus informationstorage unit for storing relationships between display screens and aplurality of identifiers of the plurality of navigation informationsequences, the display screens displaying the composite image combinedby the reproduction controlling unit, wherein the extract controllingunit includes: an extract condition setting unit for receivinginformation indicating one out of the display screens from thereproduction controlling unit, obtaining from the apparatus informationstorage unit an identifier of a navigation information sequence whichcorresponds to the display screen indicated by the information receivedfrom the reproduction controlling unit, and setting a condition forextracting navigation information in the extracting unit.
 7. Thebroadcast reception apparatus of claim 6, wherein the display screensincludes a wide screen with aspect ratio 16:9, a normal screen withaspect ratio 4:3, and a small-scale LCD (Liquid Crystal Display),navigation information corresponding to the wide screen includes displayposition information with indicates a position for displaying graphicsdata, the position being a right-hand side and a left-hand side blankareas generated when a normal-size image is displayed on the widescreen, navigation information corresponding to the normal screenincludes display position information which indicates a position fordisplaying graphics data, the position being a top and bottom blankareas generated when a wide-size image is displayed on the normalscreen, and navigation information corresponding to the small-scale LCDincludes display position information which indicates a position fordisplaying graphics data, the position being almost a whole displayarea, the extract controlling unit includes: a size receiving unit forreceiving image size information specifying either of a wide size and anormal size concerning an image of the video data; and a displayinstructing unit for instructing the reproduction controlling unit todisplay the graphics data on a display screen at a position indicated bythe display position information in accordance with the informationindicating one out of the display screens received from the reproductioncontrolling unit and in accordance with the image size informationreceived by the size receiving unit.
 8. A broadcast reception apparatusfor receiving broadcast data as a transport stream, wherein thetransport stream includes video data and a plurality of navigationinformation sequences, each of the plurality of navigation informationsequences includes navigation information which includes graphics datato be combined with the video data for display, the broadcast receptionapparatus comprising: extracting unit for extracting the video data andnavigation information from the transport stream; extract controllingunit for controlling the extracting unit so that the extracting unitextracts navigation information from one out of the plurality ofnavigation information sequences which is related to the broadcastreception apparatus; navigation information storage unit for storing thenavigation information extracted by the extracting unit; reproductioncontrolling unit for combining graphics data included in the navigationinformation stored in the navigation information storage unit with thevideo data extracted by the extracting unit and displaying a compositeimage which is a result of this combination; operation receiving unitfor receiving a user operation; a modem connected to a public network;and apparatus information storage unit for storing a telephone number ofa connection destination to which the modem is connected, wherein theextract controlling unit includes: an authority checking unit forreading the telephone number, connecting to the connection destinationby the modem, and checking whether a pay broadcast program is to beviewed when the extracting unit extracts video data of the pay broadcastprogram and the operation receiving unit receives a user operationindicating that the user selects the pay broadcast program; a firstextract condition setting unit, when the authority checking unitreceives a confirmation that the pay broadcast program is to be viewed,for setting a condition in the extracting unit for extracting navigationinformation included in a navigation information sequence related to theconfirmation that the pay broadcast program is to be viewed; and asecond extract condition setting unit, when the authority checking unitreceives an answer that the pay broadcast program is not to be viewed,for setting a condition in the extracting unit for extracting navigationinformation included in a navigation information sequence related to theanswer that the pay broadcast program is not to be viewed.
 9. Thebroadcast reception apparatus of claim 8, wherein the authority checkingunit receives information of a permitted audience time period togetherwith the confirmation that the pay broadcast program is to be viewed,the extract controlling unit includes: a timer unit for activating thesecond extract condition setting unit when the permitted audience timeperiod has expired.
 10. A broadcast reception apparatus for receivingbroadcast data as a transport stream, wherein the transport streamincludes video data and a plurality of pieces of navigation informationwhich includes graphics data to be combined with the video data fordisplay, the broadcast reception apparatus comprising: operationreceiving unit for receiving a user operation; extracting unit forextracting the video data and navigation information from the transportstream; extract controlling unit for controlling the extracting means sothat the extracting unit extracts two or more pieces of navigationinformation out of the plurality of pieces of navigation information inaccordance with the user operation received by the operation receivingunit; navigation information storage unit for storing the two or morepieces of navigation information extracted by the extracting unit;apparatus information storage unit for storing information indicating anavigation information sequence in which the navigation information isto be extracted; and reproduction controlling means for combininggraphics data included in the two or more navigation information storedin the navigation information storage unit with the video data extractedby the extracting unit and displaying a composite image which is aresult of this combination.
 11. The broadcast reception apparatus ofclaim 10, wherein the user operation received by the operation receivingunit is a user attribute, and each of the plurality of pieces ofnavigation information includes graphics data corresponding to a userattribute.
 12. The broadcast reception apparatus of claim 11 furthercomprising: a modem connected to a public network, wherein the apparatusinformation storage unit stores a telephone number of a connectiondestination to which the modem is connected; and transmitting unit fortransmitting data to the connection destination by the modem, the datacorresponding to a response by a user to the graphics data displayed bythe reproduction controlling unit.
 13. A computer-readable record mediumto be used for a broadcast reception apparatus, wherein the broadcastreception apparatus receives broadcast data as a transport stream, thetransport stream includes video data and a plurality of navigationinformation sequences, each of the plurality of navigation informationsequences includes navigation information which includes graphics datato be combined with the video data for display, the computer-readablerecord medium recording a program which is run on the broadcastreception apparatus and includes: an extracting step for extracting thevideo data and navigation information from the transport stream; anextract controlling step for controlling the extracting step so that theextracting step extracts navigation information from one out of theplurality of navigation information sequences according to informationstored in a apparatus information storage unit, the informationindicating a type of a navigation information sequence from which thenavigation information is to be extracted; a navigation informationstorage step for storing the navigation information extracted by theextracting step into a navigation information storage unit; and areproduction controlling step for combining graphics data included inthe navigation information stored in the navigation information storageunit with the video data extracted by the extracting step and displayinga composite image which is a result of this combination.
 14. A recordmedium to be used for a broadcast reception apparatus, wherein thebroadcast reception apparatus receives broadcast data as a transportstream, wherein the transport stream includes video data and a pluralityof pieces of navigation information which includes graphics data to becombined with the video data for display, the broadcast receptionapparatus comprises: an extracting unit for extracting the video dataand navigation information from the transport stream; apparatusinformation storage means for prestoring information indicating a typeof a navigation information sequence from which the navigationinformation is to be extracted; and a navigation information storagemeans for storing two or more pieces of navigation information extractedby the extracting means, a program is recorded in the record medium, theprogram includes: a determining step for determining a user operation;an extract controlling unit for controlling the extracting unit so thatthe extracting unit extracts the two or more pieces of navigationinformation out of the plurality of pieces of navigation information inaccordance with the user operation determined in the determining stepand the information stored in the navigation information type storagemeans; a combining step for combining together two or more pieces ofgraphics data included in the two or more navigation information storedin the navigation information storage unit; and a combination displayingstep for combining the graphics data combined in the combining step withthe video data extracted by the extracting unit and displaying acomposite image which is a result of this combination.